SPECIFICATION 



TO ALL WHOM IT MAY CONCERN: 

BE IT KNOWN THAT I, GENNOSUKE MUTOH , a citizen 
of Japan residing at Kanagawa , Japan has invented 
certain new and useful improvements in 

IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD 

AND PROGRAM 



of which the following is a specification:- 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to an image 
processing apparatus, an image processing method, and a 
5 program by which an image processing, such as an image 
size-change processing or so can be performed on digital 
image data of an original image efficiently. 

2. Description of the Related Art 

10 Usually, with an image processing apparatus, 

such as a copying machine or a printer, an image is 
output or printed out after being changed in its size in 
many cases. For example, when printing out a 
photographic image taken with a digital camera via a 

15 printer, generally a change in size into an image 
suitable for the size of a printing paper may be 
performed . 

A case where magnification processing (or 
enlargement processing) in which the number of pixels of 

20 an original image is increased will now be discussed, 
for example. For example, as shown in FIG. 1A, an 
original image which has an outline containing an edge 
portion of a 45-degree oblique line will now be 
discussed. In this case, it is assumed that this 

25 original image is increased twice in each dimension. 



That is, each pixel is multiplied into 4 pixels with the 
pixel value unchanged, for example. In this case, a 
black pixel 'a' of this figure turns into black pixels 
al, a2 , a3 , and a4 as shown in FIG. IB. In this case, a 
so-called jaggy phenomenon well-known occurs in a 
conspicuous manner as shown in FIG. IB in which the edge 
part includes a shape like 'stair steps'. 

In order to solve this problem, a so-called 
jaggy processing may be applied. By this jaggy 
processing, a jaggy phenomenon such as that mentioned 
above becomes less conspicuous. FIG. 2 shows a flow 
chart according to this scheme. 

As shown, after inputting an image before a 
magnification process in this case (Step SI), 
predetermined image processing is performed (Step S2) . 
In this case, without applying the scheme of simply 
multiplying each pixel into 4 pixels as mentioned above, 
a certain operation is performed by using pixel values 
of pixels surrounding the relevant pixel. Thereby, for 
example, from the original pixel 'a' shown in FIG. 1A, 
four pixels al , a2 , a3 and a4 are produced as shown in 
FIG. 1C. As shown, in this scheme, the pixel x a' is not 
simply multiplied into four pixels each being a black 
pixel, but the thus-produced pixels al , a2 , a3 and a4 
are those of one white pixel and other three black 
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pixels. As can be seen clearly from FIGS. IB and 1C, 
the jaggy phenomenon becomes less conspicuous 
accordingly. Thus, the edge part of 45-degree slant, 
becomes smoother as shown in FIG. 1C (i.e., the above- 
5 mentioned 'stair steps' are made finer) . 

Such a jaggy processing which enables the 
above-mentioned operation is disclosed, for example, by 
Japanese laid-open patent application No. 2001-188900 
filed by the present applicant. 

10 Thus, it is possible by performing jaggy 

processing, to improve the quality of image of after the 
magnification. That is, originally the relevant 45- 
degree slant part is a smooth straight line of in a 
smooth photographic subject with a 45-degree slant, and, 

15 as a result of being taken by a digital camera, such a 

stair-like jaggy phenomenon occurs due to a quantization 
• error in the digital camera according to a resolution 
performance thereof. Therefore, it can be said that, 
when the relevant image is expanded or magnified, the 

20 state shown in FIG. 1C is more similar to the original 
subject image than the state shown in FIG. IB. 

However, in case such a jaggy processing is 
performed as mentioned above, a certain operation or 
calculation should be performed for each pixel with 

25 reference to peripheral pixels as mentioned above. 



Accordingly, an extra processing time is needed for 
processing each pixel. Thereby, a considerable time is 
needed for processing the entire image consequently. 

For a user, it is preferable that an image 
which expresses a photographic subject more precisely 
through such jaggy processing. However, in many case, a 
user also needs a reduction in the processing time taken 
That is, in some case, for a user, no jaggy processing 
should be performed in case a very long processing time 
is needed therefor even when a resulting printed matter 
shows a somewhat serious jaggy phenomenon. Especially 
in a case where the size of original image data is very 
large, i.e., the data amount thereof is very large, a 
very long time may be required for the jaggy processing 
throughout the given image data accordingly. Such a 
condition may not be necessarily preferable for a user. 

In order to solve this problem, a scheme 
disclosed by Japanese laid-open patent application No. 
5-233789 may be applied. According to this scheme, as 
shown in FIG. 3, a magnification way is selected from 
among a way of Step S13 or a way of Step S15 for an 
original image according to a result of comparison of 
the data amount of the original image with a 
predetermined reference value (Step Sll) . However, 
according to this art, there is a possibility that a 
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difference arises remarkably depending on which of the 
ways is thus selected from the above-mentioned 
comparison with respect to a required data processing 
time, an image quality of the thus-processed image, or 
5 so. When the data amount of the original image is in 
accident very near the above-mentioned reference value, 
the way to be selected differs according to a very small 
difference in the data amount, and, then, the required 
data processing time and/or the image quality of the 

10 thus-processed image may differ remarkably. 

Such a tendency may become more remarkable 
with a recent increase in the resolution performance of 
the image input device or increase in the required image 
quality. That is, since thereby it becomes possible to 

15 input an original image with a large image data size at 
a high resolution, the data amount to be processed in 
size-change processing, such as a magnification, a size- 
reduction, etc. increases accordingly. . For this reason, 
the time required to process the data concerned 

20 increases accordingly. When the time needed for the 

image data processing as a result becomes much larger, a 
situation which does not necessarily match a requirement 
of a user may occur with respect to a time which the 
user can permit. 

25 Similar problem may occur not only in a case 
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of image size magnification but also in a case of image 
size reduction for digitized image data. In a case of 
image size reduction, in terms of required data 
processing time, a way of image size reduction employing, 
5 so-called, a simple thinning-out processing may be 

advantageous. In this scheme, the number of pixels is 
simply reduced. However, in such a scheme, in which no 
special concern is made as to a color of each pixel, as 
to what a relation relating pixels have, or so, 
10 essential drawing information such as a thin line 
drawing may be lost in some case. 

Such a problematic situation will now be 
described in a specific example. For example, a case 

where an original image of 8x8 pixel configuration 
15 shown in FIG. 4A is reduced to a half in size, or a 1/4 
in area, will now be discussed. In this case, a 
predetermined one is selected from among each unit of 4 

. pixels of 2 x 2, for example, such as those enclosed by 
broken lines in FIG. 4A, while the other three pixels 

20 are ignored. In order to simplify the description, it 
is assumed that, in an original image shown in FIG. 4A, 
pixels of halftone dots represent black pixels while 
pixels of blank squares represent while pixels. That is, 
as shown, the original image has a horizontal stripe 

2 5 pattern. 
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In this case, it is also assumed that a law or 
an algorithm is provided by which the top-left pixel is 

selected from among the four pixels of each 2x2 pixel 
unit in size-reduction process. As a result, the thus- 
5 size-reduced image is that shown in FIG. 4B. As shown, 
the image resulting becomes completely different from 
that before being thus processed shown in FIG. 4A. That 
is, the horizontal stripe pattern is lost and an 
entirely black painted image occurs. 

10 FIGS. 5A and 5B shows another example in which 

the above-mentioned same law/algorithm of size reduction 
is applied to an original image which is almost the same 
as that in the example of FIG. 4A. In this case, as ■ 
shown, on the contrary, the resulting image is of an 

15 entirely white painted image. Thus, in case the simple 
thinning-out-type size reduction is performed, the image 
resulting becomes completely different in impression 
only due to a difference in position of image pattern of 
the original image. 

20 When reducing an image, unlike a case of 

magnification, the information amount of pixels is 
reduced absolutely, and,- thereby, basically it is not 
possible to secure 100 % of the original data. 
Accordingly, it is necessary to devise a certain special 

25 idea by which the outline of an original image is 
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maintained for the purpose of substantially improving 
the image quality even through size reduction processing. 

FIGS. 6A through 6C illustrate another example 
of a case the above-mentioned simple thinning-out-type 
5 size reduction scheme is applied, and a way of 

maintaining the outline of an original image. When the 
size reduction processing according to the simple 
thinning-out scheme is applied to an original image 
shown in FIG. 6A, a size-reduced image shown in FIG. 6B 

10 is obtained, for example, in which the outline of the 

original image is clearly damaged. In contrast thereto, 
a special idea may be applied in which each pixel after 
reduction is determined with reference to surrounding 
pixels of a target pixel before reduction. Thereby, a 

15 reduced image shown in FIG. 6C is obtained. In FIG. 6C, 
by utilizing intermediate image tone levels in addition 
to completely black and white pixels, the outline of the 
original image is maintained to a certain amount even in 
the reduced image, as shown. 

20 Thus, by employing a technique of determining 

a pixel value after reduction processing using 
information of surrounding pixels, it is possible to 
maintain the impression of an original image to a some 
extent even after the reduction processing. However, 

25 when such a certain type of advanced image processing is 
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performed and thus a loss of the original image data is 
substantially avoided as much as possible, the amount of 
processing required increases also in the reduction 
processing, and the processing speed will be degraded as 
5 in the case of above-mentioned magnification processing 
as a result. 

The above-described art of the Japanese laid- 
open patent application No. 5-233789 may also be used as 
a way of solving of the above-mentioned problem, in 

10 which, the data amount/size of the original image is 
compared with a predetermined reference value, and 
according to the comparison result, a way of image size 
change applied is selected. However, also in the case 
of size reduction, with this technology, a remarkable 

15 difference may occur in a resulting image quality due to 
a difference in the way of processing currently selected, 
as mentioned with reference to FIGS. 6A, 6B and 6C . 
Also, the same problem as that in a case of image 
magnification may occur such that the data processing 

20 time required and/or data quality obtained differs 

remarkably due to a small difference in the original 
data amount in case the data amount is very close to the 
predetermined reference value. 

25 SUMMARY OF THE INVENTION 



-11- 



The present invention has been devised for 
solving the above-mentioned problems, whereby an image 
quality can be maintained as much as possible or 
original image information can be maintained as much as 
5 possible even through such an image size-change 

processing with a minimum necessary data processing 
amount required. 

Another object of the present invention is to 
avoid a situation such that, as mentioned above, a 
10 difference in various conditions of image processing 

performed will not result in a remarkable difference in 
a resulting image quality or a data processing time 
required. 

According to the present invention, in case of 
15 performing image size-change processing such as an image 
size magnification or image size reduction (such a image 
size-change processing will be simply referred to as a 
size-change processing) , a combination is made between' a 
plurality of image processing ways at a predetermined 
20 combination sharing ratio thereamong. The above- 
mentioned plurality of image processing ways may include 
a first processing way such as that which . includes a 
relatively high-order or not-simple processing such as a 
jaggy processing described above in case of size 
25 magnification, or an intermediate tone processing such 
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as that mentioned above with reference to FIG. 6C in a 
case of size reduction, and a .second processing way such 
as that which on the contrary includes relatively simple 
processing such as a simple pixel multiplication in 
5 image size magnification or a simple thinning-out- type 
size reduction mentioned above with reference to FIGS. 
IB, 4B, 5B and 6B. Thereby, it becomes possible to 
achieve an image data processing for a size change with 
substantially maintaining the information of an original 

10 image as much as possible or maintaining the original 
image quality, within a predetermined time duration. 

Thus, according to the present invention, a 
comparatively high-order first processing way and a 
comparatively simple second processing way are applied 

15 to an original image together in a manner of combination. 
In this time, the combination sharing ratio between the 
first and second processing ways is appropriately set 
for the original image. The above-mentioned combination 
sharing ratio is preferably controllable according to 

20 given various conditions. Of course, the number of 

processing ways which are to be applied in a combination 
manner as mentioned above is not limited to the two, and 
any other number more than two also can be applied in 
the same manner. 

25 According to the present invention, it becomes 
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possible to freely control the combination sharing ratio 
applied according to various conditions given. Thereby, 
a user can freely alter the above-mentioned combination 
sharing ratio applied for each case according to 
5 conditions which should be satisfied in achieving a 
desired image data processing, and, thus, it becomes 
possible to perform the desired image processing with 
optimum conditions which match the particular 
requirements given. 

10 According to the present invention, even an 

original image to be processed has a different 
characteristic or attribute, by appropriately adjusting 
the above-mentioned combination sharing ratio applied 
between the plurality of types of processing ways 

15 according to the characteristic or attribute, it becomes 
possible to achieve execution of the image processing at 
a best image quality within a fixed processing time 
required or a fixed processing amount required for the 
execution, without regard to the 

20 characteristic/attribute of the original image. 

Furthermore, according to the present 
invention, based on image information which defines each 
of a plurality of pixels which are arranged two- 
dimensionally in an original image, an image size of the 

25 original image is changed. One aspect of the present 



invention includes a comparison part which compares an 
image information amount which indicates each of various 
types of image information of an original image, with a 
predetermined reference value previously set for the 
respective types of image information; and a selection 
part which determines an application share ratio between 
a first processing way and a second processing way, 
wherein the first processing way is a way of performing 
a size-change processing, and the second processing way 
is a way of also performing size-change processing which 
is different from the first processing way. 

In this case, the above-mentioned first 
processing way is preferably a way of image processing 
of high-order especially configured to effectively 
control or reduce image quality degradation which may 
otherwise occur due to a relevant size-change processing. 
On the other hand, the above-mentioned second processing 
way is preferably a simple way of image processing, such 
as a simple pixel multiplication in case of 
magnification, or a simple pixel thinning-out the 
reduction . 

Then, the above-mentioned selection part 
preferably performs the following control operations: 
In case a time required for achieving all the necessary 
process to be executed for a predetermined size-change 
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processing only in the above-mentioned first processing 
way exceeds a predetermined time allowed for the desired 
size-change rate performed on an original image, the 
above-mentioned second processing way is also used 
5 together with the above-mentioned first processing way 
in a combination manner. Otherwise, only the first 
processing way is applied for all the process required. 
In case the combination manner is applied between the 
first and second processing ways, a combination sharing 

10 ratio is determined, and, thereby, it becomes possible 
to achieve the size-change processing for the desired 
size-change rate within the predetermined time allowed. 

In one case, the above-mentioned type of 
information for which the above-mentioned comparison 

15 part makes a comparison may be the size-change rate 

applied in the size-change processing on the original 
image, the size of the original image, the available 
number of colors which each pixel can express on the 
original image, the resolution of the original image, or 

20 so. 

Other objects and further features of the 
present invention will become more apparent from the 
following detailed description when read in conjunction 
with . the accompanying drawings . 



25 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. 1A, IB and 1C illustrate a difference in 
a resulting image depending on a way of processing 
applied in case of image size magnification processing; 
5 FIG. 2 shows an operation flow chart of an 

image processing method in a related art; 

FIG. 3 shows an operation flow chart of 
another image processing method in a related art; 

FIGS. 4A, 4B, 5A and 5B illustrate a problem 
10 occurring in image size reduction; 

FIGS. 6A, 6B and 6C illustrate one advanced 
way of image size reduction solving the above-mentioned 
problem; 

FIG. 7 shows an operation flow chart of an 
15 embodiment of an image processing method according to 
the present invention; 

FIG. 8 shows a block diagram of an image 
processing apparatus according to the present invention; 

FIGS. 9, 10 and 11 show embodiments of various 
20 types of image processing systems according to the 
present invention; 

FIG. 12 shows an operation flow chart of a 
first embodiment of an image processing method according 
to the present invention; 
25 FIGS. 13A, 13B and 13C illustrate a second 
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processing way of size magnification, or a simple pixel 
multiplication way which can be applied to each 
embodiment of the present invention; 

FIG. 14 shows an operation flow chart of a 
5 method of calculating an intermediate size-change rate 
applicable to some embodiments of the present invention; 

FIG. 15 shows an operation flow chart of a 
second embodiment of an image processing method 
according to the present invention; 
10 FIG. 16 shows an operation flow chart of a 

third embodiment of an image processing method according 
to the present invention; 

FIG,. 17 shows an operation flow chart of a 
fourth embodiment of an image processing method 
15 according to the present invention; 

FIG. 18 shows an operation flow chart of a 
fifth embodiment of an image processing method according 
to the present invention; 

FIG. 19 shows an operation flow chart of a 
20 sixth embodiment of an image processing method according 
to the present invention; and 

FIG. 20 shows an operation flow chart of a 
seventh embodiment of an image processing method 
according to the present invention. 



25 
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DESCRIPTIQN OF THE PREFERRED EMBODIMENTS 

Hereinafter, embodiments the present invention 
will be described in detail with reference to drawings. 

FIG. 7 shows a processing flow chart which 
shows a concept of each embodiment of the present 
invention . 

Here, a case where two types of image size- 
change methods are prepared will be described. 

In Step S21, a predetermined reference value N 
held in an image processing apparatus is referred to. 
This reference value N is a reference value previously 
determined for each type of information, such as a 
information/data amount of an original image, a size- 
change rate to be achieved, a number of available colors 
in the original image, or so, and the above-mentioned 
value N may be provided for each of the number of 
possible various different types of such information 
mentioned above. Furthermore, when controlling a size- 
change processing method finely, it is also possible to 
prepare a plurality of values N for each of these 
information types , and to appropriately use them in a 
manner of combination appropriately. Hereinafter, a 
case where one reference value N is set for each 
information type, and a reference value Nx of a certain 
information type thereof is applied. 
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For example, when an information value of the 
original image to be processed corresponding to the 
above-mentioned reference value Nx is Dx, in Step S21, a 
comparison is made on this Dx with the reference value 
5 Nx . Then, when Dx is below Nx , all the necessary image 
processing to a predetermined size-change rate Z is 
performed by a predetermined first processing way (Step 
S24) . ' 

On the other hand, when Dx exceeds Nx , it may 

10 be determined that if all the necessary processing were 
performed by the first processing way for the required 
size-change rate Z, the processing time thus taken would 
increase remarkably. Accordingly, in this case, the 
first processing way is applied only for a predetermined 

15 intermediate size-change rate Zm smaller than the 
finally required size-change rate Z (in Step S22). 

As for the above-mentioned predetermined 
intermediate size-change rate Zm, it is preferable to 
determine it such that all the necessary processing 

20 including that in the above-mentioned predetermined 

first processing way and that in a predetermined second 
processing way can be completed within a predetermined 
time allowed. 

Then, after the processing to the intermediate 

25 size-change rate Zm by the first processing way is 
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executed, in Step S23, the remaining size-change 
processing for the finally required size-change rate Z 
is performed by the predetermined second processing way. 

As will be described later, the above- 
mentioned predetermined first processing way is a way of 
image size- change processing especially configured to 
effectively reduce a degradation of image quality which 
would otherwise occur due to the size-change processing, 
and , for this purpose , including a certain 
calculation/operation processing which thus may require 
a relatively increased time to perform, or a relatively 
increased amount of data processing. In contrast 
thereto, the above-mentioned second processing is 
normally a simple image size-change processing such as a 
way of simply multiplying pixels in size magnification 
processing or a way of simply pixel thinning-out 
processing in size reduction, which normally includes no 
special processing required for effectively reducing a 
degradation of image quality which would otherwise occur 
due to the size-change processing, and, as a result, 
requires the minimum data processing time or minimum 
data processing amount . 

FIG. 8 is a block diagram showing an example 
of configuration of an image processing apparatus 
applicable to each embodiment of the present invention, 
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a basic scheme of which have been described above. 

The image processing apparatus 1 includes an 
interface part 10 for exchanging signals with the 
exterior, a memory part 20 which stores temporarily data 
5 of the signal exchanged with the exterior through the 
interface part 10, a CPU part 30 which carries out 
actual image processing in this image processing 
apparatus, and a hard disk drive 40 which saves image 
data processed in the CPU part 30. 
10 The above-mentioned interface part 10 includes 

an input part 11 which receives image data supplied from 
the outside, and an output part which outputs image data 
having undergone processing in this image processing 
apparatus . 

15 The above-mentioned memory part 20 includes an 

input data storing part 21 which stores image data input 
through the input part .11 of the interface part 10, and 
an output data part 22 storing image data temporarily 
having undergone processing by the CPU part before 

20 sending it out. 

The above-mentioned CPU part 30 includes a CPU 
and a memory, performs various types of processing by 
executing programs loaded in the memory. The CPU part 
thus performs each function to act as an image 

25 processing comparison part 31, an image processing 



selection part 32, and an image processing part 33, 
which will be described. A processing operation of each 
part executed by the CPU part 30 is realized, for 
example, as a result of a respective software program 
being executed by the CPU. 

Operations of this image processing apparatus 
will now be described. First, an original image is sent 
to the input part 11 of the interface processing part 10 
through an I/F 50. The sent original image is held as 
an input original image in the memory 20 or so, and is 
set as a target of image processing. Next, the image 
processing comparison part 31 actually realized by the 
CPU part 30 as mentioned above obtains various types of 
image information from the input original image such as 
a data size, a rate of image size reduced, the number of 
colors used, etc., reads a threshold for each type of 
information from a comparison table 41 previously stored 
in the hard disk 40, performs a comparison of each type 
information read with the above-mentioned threshold, and 
sends a comparison result to the image processing 
selection part 32. 

The image processing selection part 32 reads 
corresponding contents of image processing to be 
executed based on the sent comparison result from a 
selection table 42 stored in the hard disk etc., so as 



to determine processing to be executed, and sends the 
contents of processing as a determination result to the 
image processing part 33. The image processing part 33 
processes the image data of the original image according 
to the sent contents of image processing. The processed 
result is output to an I/F 50' from the output part 12 
of the interface processing part 10 after being held as 
an output original image in the memory 20. 

That is, the image processing comparison part 
31 performs comparison operation of Step S21 of FIG. 7, 
the image processing selection part 32 performs 
operation for choosing an intermediate size-change rate 
which shows a processing-way sharing ratio between the 
first processing way and the second processing way, 
based on the result of comparison by the above-mentioned 
comparison part 31, and the image processing part 33 
performs image processing of respective Steps S22, S23, 
and S24. 

In that case, the image processing comparison 
part 31 of the CPU part 30 compares the above-mentioned 
reference value Nx stored in the comparison table 41 
beforehand saved in the hard disk part 40 with the 
corresponding information value Dx supplied from the 
input data part of the memory part 20, for example, the 
information amount of the relevant image data, and thus, 



performs the comparison operation of Step S21. 

In the image processing selection part 32 of 
the CPU part 30, the intermediate size-change rate Zm 
for which a size-change processing in the first 
processing way is executed is chosen according to a 
matter as to how much the selection information stored 
in the selection table 42 of the hard disk part 40, for 
example, the information amount Dx of the corresponding 
image data exceeds the reference value Nx (Step S33) , in 
a manner which will be described later. 

Then, in the image processing part 33 of the 
CPU part 30, according to the comparison result from the 
image processing comparison part 31, and also, according 
to the selection result from the image processing 
selection part 32 in case of 'exceeding the reference 
value' occurring as the above-mentioned comparison 
result, the predetermined image processing is performed 
on the relevant image data, and, the image data thus 
processed is sent to the output data part 22 of the 
memory part 20 in which it is stored temporarily to be 
output externally after that. 

Examples of system configuration in a case of 
applying the image processing apparatus according to the 
embodiment of the present invention to an actual 
computer system etc. will now be described. In such a 



case, three types of system configurations are 
considered and will be described with reference to FIGS. 
9, 10 and 11. 

FIG. 9 shows a case where the image processing 
apparatus according to the above-described embodiment of 
the present invention is included in a printer driver 
(program) which is installed in a personal computer 100 
together with other applications. In this case, the 
image processing apparatus is of a program, in fact, and 
corresponds to a program which controls operation of the 
CPU in the CPU part 30 in the configuration shown in FIG. 
8, and thus realizes the above-mentioned respective 
functions, of the image processing comparison part 31, 
the image processing selection part 32, and the image 
processing part 33. In this case, the other portions of 
the image processing apparatus of FIG. 8 are realized by 
the respective functions which the personal computer. or 
so 100 originally has, i.e., the interface function, the 
memory function, the CPU, the hard disk, etc. 

The image data thus processed with the image 
processing apparatus in this case is transmitted to an 
output unit 200, such as a printer, and an output 
processing of printing out etc. is carried out there. 

FIG. 10 shows a case where the image 
processing apparatus according to the embodiment of the 
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present invention is realized as an image processing 
circuit mounted in an output unit, such as a printer, 
with other necessary output control circuits. In this 
case, the image processing apparatus is realized in fact 
5 by an LSI circuit which has a firmware. A program which 
controls operation of the CPU in the CPU part 30 in the 
configuration shown in FIG. 8 so as to realize the 
above-mentioned respective functions as the image 
processing comparison part 31, the image processing 

10 selection part 32, and the image processing part 33, 

respectively, is mounted as a firmware etc. in the LSI 
circuit. The functions of these respective parts are 
realized by controlling operation of the CPU included in 
the LSI circuit according to the firmware. 

15 The other portions of the image processing 

apparatus of FIG. 8 are realized in this case by 
predetermined functional circuits also included in the 
LSI circuit. The configuration of the hard disk part 40 
of FIG. 8 may be realized, not only by a hard disk drive 

20 unit but also by another memory device, for example, a 
semiconductor memory device etc. 

Then, in this case, image data supplied from 
the computer 110 is processed with the image processing 
apparatus thus-included in the output unit 210, and an 

25 output processing of printing etc. is carried out under 
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the control of an output control circuit or so also 
included there. 

FIG. 11 shows another example in which the 
image processing apparatus according to the embodiment 
5 .of the present invention is formed independently as an 
external apparatus. In this case, the image processing 
apparatus carries out operation described above with 
reference to FIG. 8, and realizes each processing 
concerned. Typically, the image processing apparatus in 

10 this case may be realized by a computer provided only 
for image processing in a form of a separate computer 
120. Alternatively, in this case, the image processing 
apparatus 1 is provided independently on an I/F 
(interface) 50, and, thus, belongs to neither the 

15 computer 120 nor the printer 220, but the part which 
connects therebetween . 

In any of the systems shown in FIG. 9, FIG. 10, 
and FIG. 11, the fundamental internal configuration of 
the image processing apparatus 1 which outputs image 

20 data of an original image after being processed by an 

application program which works on the computer, such as 
a personal computer, to an output unit, such as a 
printer, is common in general. 

Below, respective specific embodiments of the 

25 present invention each having the above-mentioned basic 
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conf iguration will now be described in detail. In each 
example, two types of processing ways, i.e., the first 
processing way and the second processing way are 
prepared for a magnification processing or a size- 
reduction processing. However, it is also possible that 
more than two types of processing ways are provided for 
each of a magnification processing and a size-reduction 
processing, and then, they may be appropriately combined 
in being applied for actual magnification/size-reduction 
processing. 

The reference value N held in the comparison 
table 41 of image processing apparatus 1 shown in FIG. 8 
is referred to in a comparison process in each 
embodiment. This reference value N may be a 
predetermined reference value determined for every image 
information provided for an original image, and may be 
provided in a several number of reference values N for 
respective types of image information. Moreover, in 
case of controlling a magnification processing or a 
size-reduction processing more finely, it is also 
possible to prepare a further plurality of sorts of 
reference values N for the above-mentioned every type of 
information. According to the respective embodiments of 
the present invention which will now be described, a 
single reference value N is applied for every 
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information type, and a certain reference value Nx (for 
example, a data size, etc.) is applied for image 
information of an original image each time of 
predetermined image processing. 
5 FIG. 12 shows a processing flow chart of an 

image processing apparatus 1 according to a first 
embodiment of the present invention. In Step S30, a 
user or an operator inputs to the image processing 
apparatus an instruction as to whether "magnification 

10 processing" or " (size-) reduction processing" should be 
performed on an original image. As a result, in case of 
magnification processing, the image processing apparatus 
1 performs a procedure starting from Step S31. 

That is, in Step S31, a comparison is made for 

15 an information amount Dx of a predetermined type of 

target image data, for example, the information amount 
of the target image data, with a corresponding reference 
value Nx (= NEx) previously held in the above-mentioned 
comparison table 41. Then, when the information amount 

20 of the image data which should be processed is smaller 

than the reference value Nx as a result (No of Step S31) , 
an applying magnifying rate is set as ZZ which is a 
magnifying rate which is previously given by the 
operator (Step S37) , and a magnification processing for 

25 the magnifying rate is carried out by the first 
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processing way' (see Japanese laid-open patent 
application No. 2001-188900 mentioned above) including 
the above-mentioned jaggy processing throughout the 
necdessar6y processing (Step S38) . 
5 On the other hand, when the information amount 

of the image which should be processed exceeds the 
reference value as a result of the comparison of Step 
S31 (Yes) , a predetermined intermediate magnifying rate 
Zm is set as a magnifying rate for which a magnification 

10 processing is performed first (Step S33) , which 

intermediate magnifying rate Zm is a magnifying rate 
occurring intermediately in the course for the final 
magnifying rate of ZZ. Then, the above-mentioned first 
processing way is applied and thus a magnification 

15 processing is performed on the given image data so as to 
achieve the above-mentioned intermediate magnifying rate 
Zm (Steps S34 and S35) . 

For example, in case of the target magnifying 
rate ZZ given is 8.4, the predetermined intermediate 

20 magnifying rate Zm is set as 8, for example. Then, up 
to the intermediate magnifying rate Zm, the 
magnification processing is processed so as to achieve 
the magnifying rate of 8 first by the first processing 
way. The first processing way which is a high-order 

25 image processing and thus, for example, includes the 
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jaggy processing and thereby, a smooth contour of a 
relevant image is obtainable as shown in FIG. 1C , in 
comparison to a case of FIG. IB which is obtained with a 
simple magnification processing and has a conspicuous 
5 jaggy phenomenon as mentioned above. 

Then, for the image data obtained from 
undergoing the magnification processing for the 8-time 
magnified image in Steps S34 and S35, a further 
magnification processing for (8.4) /8 times is performed 

10 in Step S36. That is, (8.4)/8 = 1.05, and thus, the 
magnification processing achieving 1.05-time 
magnification is performed. Thereby, the final 
magnification rate of 8.4 times is obtained. In this 
case, a simple magnification processing such that, 

15 thereby a result as shown in above-mentioned FIG. IB is 
obtained, is carried out for the remaining magnification 
for (8 . 4) /8 . 

Thus, according to the first embodiment of the 
present invention, the first advanced magnification 

20 processing with the jaggy processing is uniformly 

performed on given image data having the information 
amount below the reference value Nx . On the other hand, 
for given image data having the information amount 
exceeding this threshold, a magnification processing for 

25 the predetermined intermediate magnifying rate is 
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carried out by the first advanced processing way 
(magnification processing including j aggy processing) 
for an intermediate magnifying rate, and then, the 
second processing way (simple magnification) simpler 
5 than the above-mentioned first processing way is applied 
for the remaining magnifying rate. 

Generally, as the processing time required for 
executing image magnification processing in the first 
processing way (jaggy processing) is significantly 

10 larger then that in the second processing way (simple 

magnification) since the former requires a larger amount 
of operation to be processed, the processing in the 
first processing way may take a much time than in the 
second processing way. In this case, for example, two 

15 sets of input image data will now be discussed which 
have respective information amounts, a difference of 
which is very small, one of which exceeds the reference 
value Nx while the other does not exceeds the same. 

In such a case of example, when the above- 

20 mentioned method described with reference to FIG. 12 is 
applied, for the larger set of the input image data, 
first, a magnification processing of partial 8 times is 
applied by the first processing way for example. Then, 
after that, the remaining magnification processing of 

25 (8.4) /8 times is performed. On the other hand, for the 



smaller set of input image, a magnification processing 
of total 8.4 times is applied by the first processing 
way. In this case, as the required time for the 
processing in the second processing way is very small as 
mentioned above with respect to that in the first 
processing way, the times required for processing the 
respective one sets of the input image data should be 
approximately the same. 

Thus, according to the present invention, even 
when conditions of images to be processed are close to 
the above-mentioned reference value Nx which is the 
threshold, the processing times taken do not differ much 
from each other, and, also, the contents of the 
processing executed are approximately equal to each 
other. Accordingly, the images obtained from the 
processing do not have a much difference in image 
quality. Thus, the above-mentioned problem occurring in 
the related art can be solved. 

On the other hand, when the required image 
processing is "size-reduction processing", a process 
starting from Step 131 is performed in FIG. 12. It is 
assumed that a required final (or target) size-reduction 
rate ZZ is input previously for the given original image. 
Then, in case an image information value of the original 
image to be compared with a reference value Nx is Dx, 
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the image processing comparison part 31 compares the 
image information value Dx of the original image with 
the reference value Nx (which is NRx that may be 
different from the above-mentioned NEx in the case of 
5 the above-mentioned magnification processing) (S131) . 
Then, when Dx is below Nx (No in Step S131) , all the 
processing for the required size-reduction rate ZZ is 
performed by the first, relatively advanced processing 
way (S137) . 

10 On other hand, in case Dx exceeds Nx (Yes in 

Step S131) , it is determined that, when all the 
processing were performed by the first processing way 
for the required final size-reduction rate ZZ, the 
necessary processing time would become longer than 

15 necessary. Then, in this case, once the processing is 
performed in the first processing way partially for an 
intermediate size-reduction rate Zm smaller than the 
final size-reduction rate ZZ. The above-mentioned 
intermediate size-reduction rate Zm is determined in 

20 Step S133 so that all the size-reduction processing for 
achieving the final required reduction rate including a 
first process for the intermediate rate Zmm by the first 
processing way and a remaining second process from the 
intermediate rate for the final size-reduction rate ZZ 

25 by the second processing way may be completed within a 
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predetermined allowable time in this case. Then, in 
Step S134, for the intermediate size-reduction rate Zm, 
size-reduction processing by the first processing way is 
performed. After that, in order to attain the final 
5 size-reduction rate ZZ required, size-reduction 

processing for the remaining rate ZZ/Zm so as to achieve 
the final rate ZZ is performed in Step S135. 

As mentioned above, also in the size-reduction 
processing starting from Step S131, image degradation 

10 can be effectively reduced, and size-reduction 

processing can be performed within a predetermined 
processing time, and the best quality of image can be 
obtained therein. 

As the above-mentioned first (advanced or 

15 high-order) processing way, for example, a so-called 

three-dimensional spline method or so may be applied for 
a size-reduction processing which is a high-order image 
processing and achieves a image size-reduction with an 
effectively controlled image quality degradation. On 

20 the other hand, as the above-mentioned simple second 
processing way, the above-mentioned simple pixel 
thinning-out processing may be applied, for example. 

In addition, in FIG. 12, since the contents of 
processing generally differ between the first processing 

25 way performed in Step S34 or S38 at a time of 
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magnif ication and the first processing way performed in 
Step S134 or S138 at a time of size-reduction, the arts 
applied may differ therebetween accordingly. Namely, 
for example, as mentioned above, the first processing 
5 way at a time of magnification may be a processing way 
including the above-mentioned jaggy processing which is 
disclosed by Japanese laid-open patent application No. 
2001-188900. On the other hand, the above-mentioned 
three-dimensional spline technology may be applied as 

10 the first processing way in the case of size-reduction 
processing, for example. On the other hand, the second 
processing way performed in Step S36 at a time of 
magnification and the second processing way performed in 
Step S136 at a time of size-reduction applied may be 

15 ones substantially common as will be described later. 

Moreover, as shown in FIG. 12, when carrying 
out combining of the first processing way which includes 
relatively advanced image processing, such as jaggy 
processing, and the second processing way such as a 

20 simple multiplication or simple thinning-out, it is 
preferable that the relatively advanced way is first 
applied, and after that, the relatively simple 
processing way is applied. The reason therefor is as 
follows : 

25 A case will now be discussed for the 
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illustration purpose in which, first a size-change 
processing were performed in the simple second 
processing way, and, thus, data in the state shown in 
FIG. IB or FIG. 4B, 5B , or 6B would be obtained. After 
5 that, a further size-change processing in the high-order 
first processing would be performed. In such a case, 
generally speaking, by the simple second processing way, 
an image degradation, in some case, a relatively serious 
one, may occur as mentioned above. Even the advanced 

10 first processing way would be applied after that, this 

once occurring degradation may not be corrected. Rather, 
when the high-grade processing way would be applied on 
the image having the degradation already occurring 
therein, the degradation would become more conspicuous. 

15 For example, a jaggy once occurring due to a first 
application of the second processing way may become 
clearer through an application of the high-grade 
processing way after that. 

On the contrary, a case where after performing 

20 size change by the advanced first processing way 

previously, and the remaining size change is performed 
with an application of the simple second processing way 
will now be discussed. In this case, generally speaking, 
a first application of the first advanced processing may 

25 hardly cause a serious image degradation. Therefore, 
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even the second simple processing way is applied after 
that on the same image for achieving the remaining size- 
change processing, an image degradation which may then 
occur in the second processing way may not cause a 
5 serious problem more than one which would inherently 
occur due to the application of the second processing 
way. In case of jaggy, when the second processing way 
is applied on an image after the image in the state 
shown in FIG. 1C is obtained from application of the 

10 high-order first processing way (jaggy corrected), a 

jaggy may then occur. However, the thus-occurring jaggy 
• should be clearly a gentle one than that occurring in 
the above-mentioned contrary case in which the first 
processing way were applied after the image had the 

15 state of FIG. IB. Thus, image degradation can be 

effectively reduced by first applying the high-order 
processing way. 

Next, a specific way which can be applied as 
the above-mentioned second processing way of simple size 

20 reduction will now be described for example , with 

reference FIGS. 13A, 13B and 13C. FIG. 13A shows a 
state of pixels before magnification. The size thereof 
is expressed by the length SH and the width SW , as shown . 
FIG. 13B shows a state of the pixels after the 

2 5 magnification . In this state , the size is expressed by 
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the length DH and the width DW . FIG. 13C shows a 
formula for calculating a value of each pixel after the 
magnification according to this simple pixel- 
multiplication magnification way. In this case, the 
5 magnifying rate applied is 1.5 times for example. 

Therefore, the number of pixels becomes 1.5 times for 
every direction, or the size is increased from 4 pixels 
to 6 pixels for each dimension as shown. 

In the formula of total three lines of FIG. 

10 13C, the first line is a formula for advancing the Y 

coordinate one by one, and the second line is a formula 
for advancing the X coordinate one by one. In the third 
line, a value of an arbitrary pixel D[Y] [X] after the 
magnification is obtained, as shown, the reciprocal 

15 SH/DH of the vertical magnifying rate is multiplied on 
the value Y, similarly SW/DW is multiplied on X, and 
then, the thus-obtained values are rounded off, 
respectively. The value of the pixel located at the 
coordinates of the thus-obtained values originally is 

20 applied as a value of the relevant pixel after the 
magnification . 

For example, in this case, the magnifying rate 
for each dimension is 1.5. Then, when the pixel hatched 
(D[2][3])in FIG. 13B is discussed, 
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2/(1.5) =1.3 -* 1 
3/ (1.5) = 2 -* 2 

Thus, as a result, 1 1 f and '2' are obtained. 
Accordingly, the relevant pixel D[2] [3] has the pixel 
value of the original pixel S[l][2]. 

The same technique can also be applied as the 
second processing way at a time of size reduction (Step 
S136) . That is, for example, the above-mentioned 
formula is applied to a case where an original image of 
8 x 8 is reduced in size into 4x4. In this case 

SW = SH = 8 
DW = DH = 4 

Then the following calculation occurs : 

for (Y=0 ,Y<4 ; Y++) { 

for (X=0 ,X<4 ; X + + ) { 
20 D[Y] [X]=S[8*Y/4] [8*X/4] ; 

} 

} 

Thus, the following results are brought: 
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Thus , the top-left pixel of every 2x2 pixel 
unit is selected from the original image, and thus, the 
same formula is also applicable for a case of size- 
reduction processing . 

Next, a specific technique for obtaining the 
above-mentioned intermediate magnifying rate Zm in the 
first embodiment described above with reference to FIG. 
12 will now be described. 
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The intermediate magnifying rate Zm (Step S32) 
or the intermediate size-reduction rate Zm (Step S132) 
can be obtained by a calculation. However, when a 
complete calculation were made for each case, a 
5 considerable time would be required. Accordingly, it is 
preferable to prepare a table which is obtained 
previously with a calculation made for each typical case, 
and, then, for each given particular image processing 
case, the above-mentioned table will be referred to 
10 appropriately. Such a reference table will be descried 
later . 

In order to determine the intermediate 
magnifying rate Zm or the intermediate size-reduction 
rate Zm first, the following values are prepared 
15 beforehand. 

First, a permissible processing time is set 
(referred to as Tt in the following calculation) . That 
is, the magnification/size-reduction processing time 
which a user can permit is set previously. Then, after 
20 that, the intermediate magnifying/size-reduction rate Zm 
is determined in such a manner that the thus-set Tt is 
not exceeded by an actual total time required. 

In determination of an actual one of the 
above-mentioned intermediate magnifying/reduction rate, 
25 a necessary processing time per unit data size Dsu is 
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calculated first. This is a processing time required 
when data of a unit data size is processed (magnified or 
reduced in size) in the above-mentioned predetermined 
first processing way (advanced processing way) or in the 
second processing way (simple processing way) so as to 
achieve a predetermined size-change rate (magnifying 
rate or size-reduction rate) . Also in this case, it is 
preferable that the calculation is previously performed 
for each of typical cases, the results are managed as a 
table, and after that, the data is utilized for each 
particular image processing case given. 

Specifically, a magnification (size-reduction) 
processing time actually required per unit size in the 
first processing way is first defined as a one- 
dimensional array Pltime[] . For example, in case of 
obtaining a processing time required for achieving a 
magnifying rate 4 or a size-reduction rate 4 (i.e., 1/4 
times, then, in any case of magnification or size 
reduction, the size-change rate is the same M', and, 
thus, each thereof will be generally referred to as a 
'size-change rate' M', for example) , a management is 
made as : 

Processing time by first processing way = Pltime [4] . 



The size-change processing time of the second 
processing way is similarly managed by a one dimensional 
array P2time[]. As the first processing way requires a 
more time as mentioned above, the following relation 
holds : 

Pltime [size-change rate] > P2time [size-change rate] . 

Assuming that a size of input data to be 
magnified is referred to as Ds , and a required (final) 
size-change rate is referred to as Zt, a total 
processing time required when the intermediate size- 
change rate Zm is set as mentioned above can be obtained 
from the following formulas (1) : 

Processing time 

= Pltime [Zm] x Ds/Dsu + P2 time [ Z t/Zm] x Ds x Zm x 
Zm/Dsu . . . (1) 

Pltime [Zm] x Ds/Dsu in the first term 
indicates a required processing time taken in case where 
a size-change processing for the intermediate size- 
change rate Zm is performed by the first processing way 
on data of the size Ds . 

P2time [ Zt/Zm] x Ds x Zm x Zm/Dsu in the second 
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term indicates a required processing time taken in case 
where, on the thus already size-changed data for the 
intermediate size-change rate Zm by the first processing 
way is then further size-changed by the second 
5 processing way for finally achieving the required final 
size-change rate Zt. In this case, since the remaining 
size-change rate amounts to Zt/Zm, the processing time 
per Dsu is P2time [Zt/Zm]. Further, since the size- 
change processing for the intermediate size-change rate 

10 Zm has been already made at this time, the size of the 
data to be further processed already has the size 
changed Zm times vertically and the size changed Zm 
times horizontally. Therefore, the data size of the 
data which then undergoes the second processing way is 

15 of Ds x Zm x Zm. For example, when the intermediate 

size-change rate Zm is "2" , the data size of data to be 
processed in the second processing way has been already 
changed by 2x2=4 (times) with respect to the 
original data size. 

20 Next, Zm is changed gradually if needed with 

comparing the processing time taken for each case with 
the above-mentioned processing time Tt, and thus, Zm at 
which the processing time taken agrees with the 
predetermined processing time Tt is obtained. Then, the 

25 thus-obtained Zm is regarded as "a final intermediate 
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size-change rate Zm at a time of carrying out size- 
change processing of input data of a relevant data size 
for a predetermined final size-change rate" within the 
predetermined time Tt, and is managed in a table as 
5 mentioned above . 

A processing for determining such a final 
intermediate size-change rate Zm in example will now be 
described with reference to a flow chart shown in FIG. 
14 . 

10 First, "2" is set as an initial value of Zm in 

Step S41. Next, In Step S42, a necessary processing 
time T in that case is calculated according to the 
above-mentioned formula (1) . Then, the necessary 
processing time thus obtained in Step S43 is compared 

15 with the above-mentioned setting time Tt. As a result, 
when the necessary processing time T is shorter, "1" is 
added to Zm in Step S4 4 . After that , the above 
processing is repeated until the processing time 
required T exceeds the setting time Tt . 

20 Then, when the necessary processing time T 

exceeds the setting time Tt (No of Step S43) , the 
current Zm is regarded as a final intermediate size- 
change rate in Step S45. However, actually, when T > Tt 
at this time, ' 1 ' is subtracted from the Zm, and the 

25 value thus obtained is regarded as a final intermediate 
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15 



size-change rate, actually. 

Specific example will now be described for a 
processing of obtaining an intermediate size-change rate 
First, Tt - 800 [ms] is assumed as a target permissible 
processing time, and a unit data size is assumed as Dsu 
= 10 [bytes] . Furthermore, the processing time required 
for each processing way per unit data size is previously 
obtained in a predetermined experimental manner, and the 
results are shown below. 
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Then, assuming that the size of input data to 
be size-changed is Ds = 100 [bytes] , and a desired size- 
change rate is Zt = 9 [times]. Then, the intermediate 
size-change rate Zm is calculated as follows by the 
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scheme described above with reference to FIG. 14. 

That is, in case Zm =2 [times] in Step S41, 

T = Pltime[Zm] x Ds/Dsu + P2time [Zt/Zm] x Ds x Zm x 
Zm/Dsu 

= Pltime[2] x 100/10 + P2time[9/2] x 100 x 2 x 2/10 
= 200 + 160 = 360 

in Step S42 . In the above calculation, 

Zt/Zm = 9/2 =4.5 

is treated as M' by taking only the integer. 

In this case, since it 800 > 360, i.e., Tt > T, 
(Yes of Step S43) , * 1' is added to Zm in Step S44, and 
calculation is performed again in Zm = 3 . 

Then, in the case of Zm =3 [times]: 

T = Pltime[3] x 100/10 + P2time[9/3] x 100 x 3x 

3/10 

= 570 

Since Tt > T also in this case, '1' is further 
added to Zm and it calculation is made further again in 
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Then, in the case of Zm =4 [times] : 



10 



T = Pltime[4] x 100/10 + P2time [ 9/4 ] x 100 x 4 x 

4/10 

= 720 



Since still Tt > T , 1 1 ' is further added to Zm 
and calculation is further performed again in Zm = 5 . 

In the case of Zm = 5 [times]: 



T = Pltime[5] x 100/10 + P2time[9/5] x 100 x 5 x 

5/10 

= 750 



15 Since still Tt > T, 1 1 ' is further added to Zm and 

it calculation is further performed again in Zm = 6. 

In the case of Zm = 6 [times] : 



T = Pltime[6] x 100/10 + P2time[9/6] x 100 x 6 x 

20 6/10 

= 960 



25 



Since finally Tt < T (No of Step S43), *1' is 
subtracted from the present Zm = 6 in Step S45, and as a 
result, Zm is determined as Zm = 5 in conclusion. 
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If such a calculation were performed each case 
a new data is input, a considerable time may be taken. 
In order to solve this problem, the following idea may 
be applied: That is, for example, it is preferable to 
5 perform such a calculation for a required processing 
time supposing various cases where the above-mentioned 
size Ds and the required size-change rate Zt are changed 
variously beforehand, and to manage the thus-obtained 
experimental results as a table at a time of first power 

10 supply is made in a relevant printer apparatus which 

applies therein the processing method according to the 
present invention. In such a case, in case of actually 
processing input data, this table is searched by using 
data of the size and required final size-change rate to 

15 be archived as key data for the search. Thereby, it 

becomes possible to obtain immediately the intermediate 
size-change rate Zm corresponding to these input 
conditions . 

This table may be created, for example, in a 
20 form of two-dimensional array such as Table [size] [size- 
change rate]. In this case, when calculating for all of 
the available data sizes one by one finely, a 
considerable time may be taken, or a considerably huge 
capacity of memory may be required for storing the 
25 calculation results for the table. In order to solve 
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this problem, an expected data size range is divided 
into some number of divisions, and, for each division of 
data sizes, the above-mentioned calculation is performed, 
and the intermediate size-change rate Zm may be obtained 
5 for each division of data size range. Namely, 

Table [1] [size-change rate] is provided as a table value 
for obtaining the intermediate size-change rate Zm in 
case where the data size Ds is not more than SI; 
Table [2] [size-change rate] is provided as a table value 

10 for obtaining the intermediate size-change rate Zm in 

case where the data size Ds is within a range between SI 
and S2; Table [ 3 ] [ si ze-change rate] is provided as a 
table value for obtaining the intermediate size-change 
rate Zm in case where the data size Ds is within a range 

15 between S2 and S3; . . . ; Table [N] [size-change rate] is 

provided as a table value for obtaining the intermediate 
size-change rate Zm in case where the data size Ds is 
more than SN . In this case, as to the size-change rate 
Zt, only an integer portion of the value of input 

20 desired size-change rate is regarded as the key for 
searching these table values . 

In this case, when input data size is SS and 
desired size-change rate is 8.5 times, and SS is 
included in the range of S3 and S4, the relevant table 

25 value is obtained as the intermediate size-change rate 
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Zm = Table [3] [8] . 

The following shows a specific example of such 
a table for reference: 



Input Data Size 

(bytes) 



Desired Size Change 
Rate 





Table [1 ] 


[1] 


* 
• 


Ds < 100 


Zt 


< 


2 






[1] 


[2] 


• 

* 


Ds < 100 


2 




Zt 


< 3 


10 


[1] 


[3] 


• 
* 


Ds < 100 


3 




Zt 


< 4 




[1] 


[4] 


• 

• 


Ds < 100 


4 




Zt 


< 5 




[1] 


[5] 


• 
• 


Ds < 100 


5 




zt 


< 6 




[1] 


[6] 


• 
• 


Ds < 100 


6 




zt 


< 7 




[1] 


[7] 


• 
■ 


Ds < 100 


7 




zt 


< 8 


15 


[1] 


[8] 


• 


Ds < 100 


8 




zt 


< 9 




[1] 


[9] 


• 

* 


Ds < 100 


9 




zt 






Table [2] 


[1] 


• 
• 


100 ^ Ds < 200 


Zt 


< 


2 






[2] 


[2] 


* 
■ 


100 ^ Ds < 200 


2 




Zt 


<3 


20 


[2] 


[3] 


■ 

• 


100 ^ Ds < 200 


3 


<^ 


Zt 


< 4 



25 



[2 
[2 
[2 
[2 
[2 



4 
5 
6 
7 
8 



: 100 ^ Ds < 200 

: 100 ^ Ds < 200 

: 100 ^ Ds < 200 

: 100 ^ Ds < 200 

•• 100 ^ Ds < 200 



4 ^ Zt < 5 

5 ^ Zt < 6 

6 ^ Zt < 7 

7 ^ Zt < 8 

8 ^ Zt < 9 
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[2] 


[9] 


: 100 





Ds 


< 


200 






9 ^ 




zt 








Table 


[3] 


[1] 


: 200 




Ds 


< 


- 

300 






Zt < 


2 










[3] 


[2] 


: 200 




Ds 


< 


300 






2 ^ 




zt 


< 


3 


5 




[3] 


[3] 


: 200 




DS 


< 


300 






3 ^ 




zt 


< 


4 






[3] 


[4] 


: 200 




Ds 


< 


300 










zt 


< 


5 






[3] 


[5] 


: 200 


<^ 


Ds 


< 


300 






5 ^ 




zt 


< 


6 




- 


[3] 


[6] 


: 200 


<: 


Ds 


< 


300 






6 ^ 




zt 


< 


7 






[3] 


[7] 


: 200 


<; 


Ds 


< 


300 






7 <: 




zt 


< 


8 


10 




[3] 


[8] 


: 200 




Ds 


< 


300 






« < 

o = 




zt 


< 


9 






[3] 


[9] 


: 200 




Ds 


< 


300 






Q < 




zt 








Table 


[4] 


[1] 


: 300 




Ds 


< 


400 






7+- 




2 










[4] 


[2] 


: 300 




Ds 


< 


400 


2 




' Zt 


< 


3 






15 




[4] 


[3] 


• 300 




Ds 


< 


400 


3 




zt 


< 


4 










[4] 


[4] 


: 300 


— *• 


Ds 


< 


400 


4 




•7 +■ 




5 










[4] 


[5] 


: 300 




Ds 


< 


400 


5 


<: 






6 










[4] 


[6] 


: 300 




Ds 


< 


400 


6 




Zt 


< 


7 










[4] 


[7] 


: 300 




Ds 


< 


400 


7 




zt 


< 


8 






20 




[4] 


[8] 


: 300 




DS 


< 


400 


8 




zt 


< 


9 










[4] 


[9] 


: 300 




Ds 


< 


400 


9 




zt 












Table 


[5] 


[1] 


: 400 




Ds 


< 


500 






zt < 




2 










[5] 


[2] 


'• 400 




Ds 


< 


500 


2 




zt 


< 


3 






25 




[5] 


[3] 


'• 400 


<; 


Ds 


< 


500 


3 




zt 


< 


4 
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[5] 


[4] 


: 400 


< 


Ds 


< 


500 


4 




zt 


< 


5 






[5] 


[5] 


* 400 




Ds 


< 


500 


5 


g; 


zt 


< 


6 






[5] 


[6] 


** 400 




Ds 


< 


500 


6 




zt 


< 


7 






[5] 


[7] 


• 400 


< 


Ds 


< 


500 


7 




zt 


< 


8 


5 




[5] 


[8] 


: 400 


< 


Ds 


< 


500 


8 


<; 


zt 


< 


9 






[5] 


[9]- 


: 400 




Ds 


< 


500 


9 


<5 


zt 








Table 


[6] 


[1] 


• 500 




Ds 


< 


600 




zt < 


2 








[6] 


[2] 


• 500 


< 


Ds 


< 


600 


2 




zt 


< 


3 


10 




[6] 


[3] 


• 500 




Ds 


< 


600 


3 




zt 


< 


4 






[6] 


[4] 


• 500 


< 


Ds 


< 


600 


4 


<- 


zt 


< 


5 






[6] 


[5] 


♦ 500 




Ds 


< 


600 


5 


<r 


zt 


< 


6 






[6] 


[6] 


• 500 




Ds 


< 


600 


6 


<; 


zt 


< 


7 






[6] 


[7] 


• 500 


< 


Ds 


< 


600 


7 


<g 


zt 


< 


8 


15 




[6] 


[8] 


500 


<; 


Ds 


< 


600 


8 


<; 


zt 


< 


9 






[6] 


[9] 


• 500 


<: 


Ds 


< 


600 


9 


g; 


zt 








Table 


: v] 


[1] 


• 600 


<; 


Ds 


< 


700 






zt 


< 


2 






[7] 


[2] 


: 600 




Ds 


< 


700 


2 


<: 


zt 


< 


3 


20 




:7] 


[3] 


= 600 




Ds 


< 


700 


3 


<g 


zt 


< 


4 






]7] 


[4] 


• 600 




Ds 


< 


700 


4 


<; 


zt 


< 


5 






!7] 


[5] 


' 600 




Ds 


< 


700 


5 




zt 


< 


6 






:7] 


[6] 


• 600 




Ds 


< 


700 


6 




zt 


< 


7 






:7] 


[7] 


: 600 




Ds 


< 


700 


7 




zt 


< 


8 


25 




:7] 


[8] 


• 600 




Ds 


< 


700 


8 




zt 


< 


9 
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[7] 


[9] 


• 


600 


<■-. 


Ds 


< 


700 


9 ^ Zt 




Table [8] 


[1] 


• 


700 




Ds 


< 


800 


Zt < 2 




[8] 


[2] 


• 


700 




Ds 


< 


800 


2 ^ Zt < 3 


5 


[8] 


[3] 


• 


700 




Ds 


< 


800 


3 ^ Zt < 4 




[8] 


[4] 




700 


' 


Ds 


< 


800 


4 ^ Zt < 5 




[8] 


[5] 


• 
• 


700 


<, 


Ds 


< 


800 


5 ^ Zt < 6 




[8] 


[6] 


* 
* 


700 


<^ 


Ds 


< 


800 


6 ^ Zt < 7 




[8] 


[7] 


• 


700 




Ds 


< 


800 


7 ^ Zt < 8 


10 


[8] 


[8] 


• 


700 




Ds 


< 


800 


8 ^ Zt < 9 




[8] 


[9] 


• 


700 




Ds 


< 


800 


9 ^ Zt 




Table [9] 


[1] 


• 


800 




Ds 






Zt < 2 




[9] 


[2] 


• 


800 




Ds 






2 ^ Zt < 3 


15 


[9] 


[3] 


• 
• 


800 




Ds 






3 ^ Zt < 4 




[9] 


[4] 


m 
* 


800 


< 


Ds 






4 ^ Zt < 5 




[9] 


[5] 


• 

• 


800 




Ds 






5 ^ Zt < 6 




■ [9] 


[6] 


• 


800 


<g 


Ds 






6 ^ Zt < 7 




[9] 


[7] 


■ 
• 


800 




Ds 






7 ^ Zt < 8 


20 


[9] 


[8] 


* 
• 


800 




Ds 






8 ^ Zt < 9 




[9] 


[9] 


• 
* 


800 




Ds 






9 ^ Zt 



Thus , the table is expressed in a form of two- 
dimensional array as mentioned above , the intermediate 
25 size-change rate Zm is calculated in the respective 
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conditions for each table value according to the scheme 
described above with reference to FIG. 14, and, the 
thus-obtained value is stored as the relevant table 
value . 

5 For example, the above-mentioned calculation 

example (Ds = 100; Zt = 9) corresponds a case where the 
data size Ds is in a range between 100 and 200 bytes, 
and the required size-change rate is not less than 9 
times. Accordingly, the intermediate size-change rate 

10 Zm = 5 which is the above-mentioned calculation result 
is thus stored in the table value of the relevant 
Table [2] [9] . 

Generally speaking, the processing contents 
are different between a magnetization processing and a 

15 size-reduction processing even both of them are included 
generally in the common concept of size-change 
processing, especially for the above-mentioned first 
processing way (advanced, high-order way). Accordingly, 
generally, the required processing time differs 

20 therebetween for each processing condition (data size of 
original image and desired size-change rate) . 
Accordingly, the above-mentioned table data with 
different contents may be prepared separately for 
magnification processing (Step S33 of FIG. 12) and for 

25 size-reduction processing (Step S133) . 
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As mentioned above, the present invention can 
be applied to both cases of 'magnification processing' 
and 'size-reduction processing' basically in the same 
manner. In case of application to a case of size- 
5 reduction processing, for the above-mentioned first 

processing way which is a high-order processing by which 
image degradation can be effectively avoided, but which 
requires a relatively longer processing time, and the 
above-mentioned second processing way which is. a simple 

10 processing which requires a less processing time but by 
which an image degradation may occur to a relatively 
serous extent, may be, for example, a well-known 'bi- 
cubic method' (first processing way) and a well-known 
'nearest neighbor method' (second processing way) may be 

15 applied, respectively. Details of these methods are 
disclosed, for example, in 'Consideration on Image 
Enlargement Methods ' written by Takashi KAWASAKI , pages 
9-11, distributed in the 45-th monthly rollout of 
Intellectual System Design Laboratory, as different ways 

20 of a resampling scheme. 

Next, a configuration of a second embodiment 
of the present invention will now be described with 
reference to FIG. 15. In the case of the second 
embodiment, for magnification processing, such a 

25 magnifying rate Nj is previously set that, a jaggy 



-58- 

phenomenon is likely to become conspicuous when the 
entire process of a magnification processing for this 
magnifying rate is performed by the above-mentioned 
second processing way. On the other hand, for size- 
5 reduction processing, such a size-reduction rate Nk is 
previously set that, an image degradation is likely to 
become conspicuous due to a More phenomenon or pixel 
loss phenomenon when the entire process of a size- 
reduction processing for this size-reduction rate is 

10 performed by the above-mentioned second processing way. 

Generally, in an image obtained after image 
processing such as a magnification processing or a size- 
reduction processing, a jaggy mentioned above at a time 
of magnification, or an image degradation resulting from 

15 a well-known Moire phenomenon or pixel loss at a time of 
size reduction tends to be more conspicuous according to 
the simple second processing way, as the rate of image 
size change, i.e., magnifying rate or size-reduction 
late becomes larger. In this embodiment, when a 

20 required image size-change rate exceeds the above- 
mentioned predetermined reference value Nj or Nk , the 
size-change processing is performed for the size-change 
rate of this reference value by the high-order first 
processing way, and, then, the simple second processing 

25 way is applied for the remaining size-change rate. 
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Specif ically , after selecting as to whether 
magnification or size reduction is performed is made in 
Step S50, when a given target size-change rate ZZ is 
smaller than the above-mentioned predetermined reference 
5 value Nj or Nk (No of Step S51, or No of Step S151), the 
relevant size-change processing is carried out by the 
first processing way uniformly for the final target 
size-change rate ZZ (Steps S56 and S57 or Steps S156 and 
S157) . 

10 On the other hand, otherwise (Yes of Step S51, 

or Yes of Step S151) , namely, when the given target 
size-change rate ZZ is larger than the reference 
magnifying rate Nj in which the above-mentioned jaggy 
would become conspicuous , or when it larger than the 

15 reference size-reduction rate Nk in which Moire etc. 

would become conspicuous (in other words, when the size 
is reduced to a much smaller one) , the magnification 
processing or size-reduction processing is performed by 
the first processing way for the size-change processing 

20 to achieve the reference rate Nj of Nk for which jaggy 
or Moire would become conspicuous if the second 
processing way were applied there (Steps S52 and S53 or 
Steps S152 and S153) . Then, after that, the remaining 
partial size-change rate (partial magnifying rate of 

25 ZZ/Nj ) or (partial size-reduction rate of ZZ/Nk) , the 
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second processing way is applied so that consequently 
the size-change processing for the target final size- 
change rate ZZ is achieved (Steps S54 and S55, Steps 

S154 and S155) . In fact, Nj x ZZ/Nj = ZZ, or Nk x ZZ/Nk 
5 = ZZ . 

Thus, according to the second embodiment 
described above, the first processing way (high-order 
processing) is applied throughout of a magnification 
processing for a magnifying rate in which a jaggy would 

10 become conspicuous, or throughout of a size-reduction 

processing for a size-reduction rate in which a Moire or 
so would become conspicuous. As a result, even a given 
target magnifying rate or given target size-reduction 
rate is large, an occurrence of image degradation due to 

15 jaggy or Moire or so can be effectively avoided. 

Further, the simple second processing is applied for the 
remaining size-change rate (ZZ/Nj or ZZ/Nk) in which 
jaggy or Moire has thus become not conspicuous as a 
result of the first application of the first processing 

20 way in a previous step. Accordingly, the required 
processing time can be effectively reduced. 

Next, a configuration of a third embodiment of 
• the present invention will be described with reference 
to FIG. 16. 

25 "Number of used colors by which it can be 



-61- 



determined as a natural image", Nn, is set as shown in 
FIG. 16. When the number of colors used (which is the 
number of available colors for every pixel, for example, 
256 colors, the number of colors which can be expressed 
5 by 16 bits or 24 bits, or so) in an original image to be 
processed is smaller than this reference value Nn (No of 
Step S61) , the first processing way of high-order 
processing is applied throughout of the required size- 
change processing for the target size-change rate ZZ 

10 (Steps S64 and S65) . On the other hand, when the number 
of colors currently used in the original image is equal 
to or more than the reference value Nn (Yes of Step S61) , 
the simple second processing (not including a high-order 
processing such as jaggy process) throughout of the 

15 required size-change processing for the target size- 
change rate (Steps S62 and S63) . 

Generally speaking, a type of an image in 
which jaggy or Moire tends to become conspicuous after 
undergoing size-change processing is, in many cases, an 

20 image having a small number of colors used there such as 
a character image (text document or so), a graphic image, 
or so. On the other hand, in case where an image has a 
large number of colors used there such as a natural 
image such as a photographic image taken via a digital 

25 camera or so, in many case, jaggy or Moire may not 
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become conspicuous even after a size-change processing 
is performed on such an image. Accordingly, in such a 
case of handling an image having a large number of 
colors used there such as a photographic image, a 
5 magnifying method should not necessarily employ a high- 
order processing way such as jaggy processing, or a 
size-reduction method should not necessarily employ a 
high-order processing way especially deigned for 
avoiding occurrence of Moire or so, even for maintaining 

10 the image quality. In other words, even such a high- 
order processing way is applied for handling such an 
image as of natural image or photographic image, an 
expected effect may not be obtained. Rather, as the 
processing time required increases accordingly, it may 

15 not be preferable for a user. 

The third embodiment has been devised in view 
of such a condition. When the number of used colors of 
an original image is larger than Nn (Yes of Step S61) , 
it is determined that the image is a natural image or so, 

20 and, thus, not the first processing way of high-order 
processing but the second processing way of simple 
processing is applied throughout of the desired size- 
change processing for the target size-change rate. 
Thereby, the required processing time can be effectively 

25 reduced . 



Next, a configuration of a fourth embodiment 
of the present invention will now be described with 
reference to FIG. 17.. When transmitting image data to a 
printer etc. from a personal computer etc. and carrying 
out a printing out of an image therewith, in order to 
compensate a difference in resolution between the 
original image data and the performance of the printer 
etc., generally,, a size-change processing such as a 
magnification processing, size-reduction processing, or 
so. is performed in many cases if necessary. In this 
case, generally, the required magnifying rate or size- 
reduction rate does not fall in an integer, but includes 
a fraction in many cases. 

"In such a case, the size-change processing for 
the required size-change rate should be performed 
includes a size-change rate of an integer and also 
another size change rate of a fraction. Such a size- 
change processing for a fraction size-change rate may 
cause an increase in the required processing time in 
general since the required operation/calculation becomes 
complicated accordingly. This tendency generally 
becomes remarkable especially in case of applying the 
above-mentioned first processing way which is high-order 
processing including a jaggy processing or a processing 
specially deigned for avoiding an occurrence of Moire or 
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pixel loss, in comparison to a case of applying the 
above-mentioned simple second processing way. 

Then, according to the fourth embodiment, when 
a given target size-change rate ZZ is of an integer 
5 value without any fraction (Yes of Step S71) , the first 
processing way which includes an advanced image 
processing, such as jaggy processing or so, is applied 
throughout the required size-change processing (Steps 
S76 and S77) . On the other hand, in case the given 

10 target size-change rate includes a fraction (for example, 
it is '8.4' or so rather than simple '8' which is an 
integer) (No of Step S71), magnification or size 
reduction for the integer size-change portion Zl ('8' in 
the above-mentioned example) is performed in the first 

15 processing way (Steps S72 and S73) . Then, after that, 
for the remaining fraction size-change portion (ZZ/Z1, 
i.e., (8. 4)/8 = 1.05, in the above-mentioned example), 
the second processing way which is a simple size-change 
processing is applied (Steps S74 and S75). That is, in 

20 the above-mentioned example, the size-change processing 
for the portion of 8.4/8 = 1.05 (times) is performed by 
the second processing way. 

Thus, according to the present invention, the 
simple second processing way is applied for the fraction 

25 portion which otherwise would require a considerable 
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processing time. Thereby, it becomes possible to 
effectively reduce the total required time. Further, 
the first processing way which includes a high-order 
processing such as a jaggy processing should be applied 
5 only for the size-change processing for the integer 
size-change portion. Accordingly, the algorism which 
should be applied for this operation/calculation can be 
effectively simplified, which would be complicated when 
the first processing way is applied also for the 
10 fraction size-change portion. Accordingly, also for 

this reason, the total required time can be effectively 
reduced . 

An eighth embodiment of the present invention 
will now be described with reference to FIG. 18. 

15 Generally, the number of available colors in each pixel 
which is the minimum unit of image data corresponds to, 
in case of a natural image, such as a photograph image, 
the number of colors expressible by 24 bits in color 
image or the number of colors expressible by 8 bits in 

20 monochrome image. In other words, it is 24-bit tone or 
8-bit tone. In a case of an image created artificially 
on the other hand such as an illustration, a graphic 
image, etc., it corresponds to the number of colors 
expressible by 1 through 8 bits in color image or the 

25 number of colors expressible by 1 through 4 bits in 
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monochrome image. In other words, it is 1-8-bit tone or 
1-4-bit tone. According to the fifth embodiment of the 
present invention, the number of available colors for 
each pixel in the original image data is set as a 
5 subject of the threshold by which the processing way is 
switched as mentioned above in the former embodiments 

Specifically, the number of available colors 
of an original image may be recognized by referring to a 
data format of the original image. Then, when it is 

10 determined that the original image has a 24-bit tone in 
color image or an 8-bit tone in monochrome image, it is 
determined that the original image is a natural image. 
Then in this case, a magnification or size-reduction 
processing is performed by the simple second processing 

15 way throughout the required rate of image magnification 
or size-reduction. Otherwise, when it is determined 
that the original image to be processed is an artificial 
image, such as a character/text image, graphic image, 
illustration or so, the required size-change processing 

20 is performed in the advanced first processing way 
throughout . 

As shown in FIG. 18, first, it is determined 
whether or not the target image data is color image data 
or monochrome image data. As a result, when it is 
25 determined as being color image data (No in Step S81) , 
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the number of usable bits per pixel is seen in Step S85. 
Specifically, it is determined whether or not the number 
of usable bits in the original image data is 8 bits. 
According to the above-mentioned example, in ease of 
5 monochrome image, it is a full-tone image when the 

number of usable bits is 8. Accordingly, in this case, 
when it is found out that the given image data is of a 
full tone image, it is determined that the relevant 
image is a natural image as mentioned above. In this 

10 case, as described in the description of the third 
embodiment, the high-order first processing way 
including jaggy processing or so is not necessarily be 
effective to be applied. Accordingly, in this case, the 
simple processing way of simple pixel multiplication or 

15 pixel thinning out processing is applied (Steps S86 and 
S87) . 

On the other hand, otherwise (No of Step S85) 
(i.e., when it is detected that a small number of usable 
bits is applied), the original image is, in a higher 

20 possibility, an artificial image, such as a 

character / text image, and thus, there is a high 
possibility that an image degradation due to jaggy or 
Moire is likely to become conspicuous. Therefore, the 
required size-change processing is carried out by the 

25 first processing way which includes advanced image 
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processing, such as jaggy processing, throughout the 
.required magnifying rate or size-reduction rate in this 
case (Steps S83 and S84) . 

Moreover, in a case of 24-bit full tone image 
5 data in case of color image (Yes of Step S82) , the 

target image is determined as being a natural image in 
the determination of Step S81, the simple second 
processing way which does not include advanced image 
processing such as jaggy processing, is applied, as in 

10 the above-mentioned case of monochrome image (Steps S86 
and S87) . Otherwise (No of Step S82, i.e., a case of an 
artificial images, such as a graphic image) , the first 
processing way of advanced image processing is applied 
(Steps S83 and S84) . 

15 Thus, in the fifth embodiment, a determination 

as to whether or not a given image is a natural image or 
so is made with a threshold which is switched according 
to whether the given image is a color image or a 
monochrome image. Therefore, in comparison to the 

20 scheme of the above-mentioned third embodiment, a given 
image can be discriminated finely at a further higher 
precision, and thus a suitable magnification or size- 
reduction processing way can be selected and applied. 
Consequently, the required processing time can be 

25 effectively reduced without lowering the quality of the 
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original image more than necessary. Furthermore, 
although the threshed for an input image is related with 
a color of an original image as in the above-mentioned 
third embodiment, it is not necessary to calculate the 
5 actual number Nn of colors of an original image in 

numerical operation in advance according to the fifth 
embodiment. Accordingly, the processing time required 
for the determination on the input image can be 
effectively reduced . 

10 Next, a configuration of a sixth embodiment of 

the present invention will now be described sixth 
reference to FIG. 19. Generally speaking, the 
processing time required increases accordingly as the 
image size of a give image becomes larger. Especially 

15 in a case where the above-mentioned first processing way 
which includes a high-order processing such as a jaggy 
processing is applied, the required processing time 
increases in proportion to the size of the relevant 
image. Accordingly, according to the sixth embodiment, 

20 the data size of a given image is applied as the 

threshold at which the processing way is switched as in 
the previous embodiments. When the size of the original 
image exceeds a reference value Nz (Yes in Step S91) , 
the first processing way of high-order processing such 

25 as a jaggy processing or so is applied first for a 
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predetermined intermediate size-change rate Zm (Steps 
S92 , S93, and S94) . Then, after that, for the remaining 
size-change rate portion (ZZ/Zm) Zm, i.e., from the 
intermediate size-change rate Zm to the final size- 
5 change rate ZZ, the second processing way of the simple 
magnification or simple thinning-out processing is 
applied (Steps S95 and S96) 

The sixth embodiment is same as the above- 
mentioned first embodiment except for the matter as to 

10 how to determine the threshold for switching as to 

whether the size-change processing is performed first in 
the first processing way and after that in the second 
processing way, or the size-change processing is 
performed throughout in the first processing way. In 

15 this case, it is preferable that the above-mentioned 

intermediate size-change rate Zm is determined also by 
the above-mentioned 'intermediate size-change rate Zm 
determination method' described above with reference to 
FIG. 14 as in the above-mentioned first embodiment. As 

20 a result, it becomes possible to effectively control the 
required processing time. Accordingly, it becomes 
possible that a size-change processing for a required 
size-change rate can be achieved within a predetermined 
time duration regardless of the size of a given image, 

25 by appropriately selecting the intermediate size-change 
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rate Zm according to the above-mentioned * intermediate 
size-change rate Zm determination method'. Accordingly, 
it becomes possible to provide a best size-change 
processing within a time duration which a user can 
5 permit. 

Next, with reference to FIG. 20, a 
configuration of a seventh embodiment of the present 
invention will now be described. 

Generally, since the size of image data 

10 becomes larger as the resolution thereof becomes higher, 
the required data processing time therefor becomes 
inevitably longer accordingly. According to the seventh 
embodiment, the resolution of a given image is applied 
as the threshold at which the processing way is switched. 

15 When the resolution of the original image to be 

processed exceeds a reference value Nr (Yes in Step 
S101) , the first processing way of high-order processing 
such as a jaggy processing or so is applied for a 
predetermined intermediate size-change rate Zm (Steps 

20 S102, S103, and S104). Then, after that, for the 

remaining size-change rate portion (ZZ/Zm) Zm, i.e., 
from the intermediate size-change rate Zm to the final 
size-change rate ZZ, the second processing way of the 
simple magnification or simple thinning-out processing 

25 is applied (Steps S105 and S106) 
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Also the seventh embodiment is same as the 
above-mentioned first embodiment described above with 
reference to FIG. 12 except for the matter as to how to 
determine the threshold for switching as to whether the 
5 size-change processing is performed first in the first 
processing way and after that in the second processing 
way, or the size-change processing is performed 
throughout in the first processing way. Also in this 
case, it is preferable that the above-mentioned 

10 intermediate size-change rate Zm is determined by the 
above-mentioned 'intermediate size-change rate Zm 
determination method' described above with reference to 
FIG. 14 as in the above-mentioned first embodiment. As 
a result, it becomes possible to effectively control the 

15 required processing time. Accordingly, it becomes 

possible that a size-change processing for a required 
size-change rate can be achieved within predetermined 
time duration regardless of the size of a given image, 
by appropriately selecting the intermediate size-change 

20 rate Zm according to the above-mentioned ' intermediate 

size-change rate Zm determination method'.. Accordingly, 
it becomes possible to provide a best size-change 
processing within a time duration which a user can 
permit . 

25 The respective embodiments mentioned above may 
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be provided separately, or may be provided in 
combination of any ones. Thus, any ones of the above- 
mentioned embodiments are combined in terms of functions 
thereof so as to form a single image processing 
5 apparatus, and there, a user may freely select any 
function corresponding to the respective one of the 
combined embodiments via an operation part such .as an 
operation panel provided on the apparatus . 

Thus, according to the present invention, a 

10 plurality of types of processing ways are appropriately 
combined for achieving a predetermined image processing 
on a given image. Thereby, a user can appropriately 
determine a sharing ratio among the thus-combined 
different types of processing ways to be applied freely 

15 in consideration of a desired image quality resulting 
from the processing, and a time required for achieving 
the processing. Accordingly, the problem can be solved 
which would otherwise occur in the related art, i.e., in 
a method of switching different types of processing ways 

20 by a threshold, and in case where, by accident, input 
data having a processing condition which is near the 
threshold, the processing quantity obtained and 
processing time required differ remarkably merely by a 
. matter as to whether the processing condition is higher 

25 or lower than the threshold. Such a problematic 
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situation can be avoided according to the present 
invention by appropriately controlling the above- 
mentioned sharing ratio among the different types of 
processing ways applied in combination. 
5 Another idea is also contrivable for the 

purpose of solving the above-mentioned problem in which 
the processing quality obtained and processing time 
required remarkably differ depending on which of 
predetermined different processing ways is selected in 

10 the method of simply switching these predetermined 

different processing ways according to the related art. 
That is, a plurality of different processing ways may be 
prepared each having a processing condition which 
gradually differs finely from each other thereamoung. 

15 However, in order to realize this method, in order to 
enable fine adjustment of condition of processing 
applied, it would be necessary to increase the number of 
the different types of processing ways to be prepared 
accordingly, and, thus, a considerable complicated 

20 configuration may be required. 

In contrast thereto, according to the present 
invention, by simply combine a plurality of arbitrary 
existing processing ways at an arbitrary sharing ratio, 
the effective can be obtained. Thus, it becomes 

25 possible to control the conditions of the processing 
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actually applied finely by appropriately controlling the 
sharing ratio for making the conditions mach the given 
requirements easily. A matter necessary to achieve the 
appropriate combination sharing ratio is merely to 
5 adjust a processing amount/rate (size-change rate, in 
the above-mentioned example) in each of the thus- 
combined processing ways according to the sharing ratio. 
Thus, according to the present invention, even with a 
simple configuration, a processing quality obtained and 

10 a processing time required for the entirety of a 

predetermined image processing can be easily controlled 
in a fine adjustment manner. Accordingly, it becomes 
possible to provide an image processing system which can 
positively respond to a variety of requirements. 

15 For example, in response to various image 

processing requirements, where a processing time 
required is fixed, it becomes possible to provide a best 
image quality within the fixed processing time according 
to the present invention. In another way, it is also 

20 possible that, throughout the entirety of a required 
image processing process, a high-order processing way 
such as to effectively avoid jaggy phenomenon may be 
applied for a range of the processing such that image 
degradation such as jaggy will no longer occur after 

25 that, and, then, after that, a simple processing way is 
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applied for the remaining range of the processing. 
Thereby, it becomes possible to obtain an image with 
appropriately controlled image degradation within the 
minimum processing time. 
5 Thus, according to the present invention, in 

response to a variety of processing conditions such as 
an image size, the number of colors, a permissible 
processing time, and so forth, the entirety of 
predetermined processing is achieved in different 

10 processing ways which are combined in a predetermined 

combination sharing ratio. Thereby, it becomes possible 
to always provide an image processing within a desired 
processing time with a desired processing quality, in 
response to various processing conditions/requirements. 

15 Further, according to the present invention, it becomes 
possible to provide a method of image processing in 
which, a required processing time and/or an image 
quality obtained do not remarkably differ even the given 
condition is slightly higher or lower than a 

20 predetermined threshold (selection reference value for 
switching among different image processing ways) . As a 
result, it becomes possible to provide an effective 
image processing efficiently in response to a 
characteristic of an original image, and, thus, it 

25 becomes possible to effectively reduce the required 
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processing time. 

Further, by executing selectively a plurality 
of processing processes having different characteristics 
respectively in response to the number of colors of an 
5 original image, it becomes possible to provide an 

effective image processing efficiently in response to 
the characteristic of the original image. As a result, 
it becomes possible to effectively reduce the required 
processing time. Also in this case by appropriately 

10 controlling the combination sharing ratio among the 

thus-combined plurality of processing processes having 
different characteristics, it becomes possible to 
achieve a scheme in that a required processing time 
and/or an image quality obtained do not remarkably 

15 differ merely according to the matter as to whether the 
given condition is slightly higher or lower than a 
predetermined threshold (selection reference value for 
switching different image processing processes) . 

Also, by executing selectively a plurality of 

20 processing processes having different characteristics 
respectively in response to a range of variation in 
pixel value (tone or shade) of an original image, it 
becomes possible to provide an effective image 
processing efficiently in response to the characteristic 

25 of the original image. As a result, it becomes possible 
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to effectively reduce the required processing time. 
Also in this case by appropriately controlling the 
combination sharing ratio among the thus-combined 
plurality of processing processes having different 
characteristics, it becomes possible to achieve a scheme 
in that a required processing time and/or an image 

r 

quality obtained do not remarkably differ merely 
according to the matter as to whether the given 
condition is slightly higher or lower than a 
predetermined threshold (selection reference value for 
switching different image processing processes) . 

Thus, according to the present invention, it 
becomes possible to provide an image processing 
apparatus and an image processing method which can 
flexibly respond to various conditions/requirements. 

Further, the present invention is not limited 
to the above-described embodiments, and variations and 
modifications may be made without departing from the 
basic concept of the present invention. 

The present application is based on Japanese 
priority applications Nos . 2002-201612 , 2002-312183 and 
2003-160942, filed on July 10, 2002, October 28, 2002, 
and June 5, 2003, respectively, the entire contents of 
which are hereby incorporated by reference. 



